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Abstract 

A technique of dynamically defined measures is developed and its rela- 
tion to the theory of equilibrium states is shown. The technique uses 
Caratheodory's method and the outer measure introduced in [27]. As an 
application, equilibrium states for contractive Markov systems [26] are 
obtained. 
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1 Dynamically defined measures 

Let £^ be a finite set and S := {(..., <7_i, CTo: ""ii •••) : cr^ G £^ G Z} equipped 
with the product topology of the discrete topologies. Let S : E — > S be 
the left shift map on S, i.e. {Sa)i = (Ji+i for all i £ Z. We call the set 
m[em, e„] := {(T G S : ai = Ci for all m < i < n} for m < n S Z, a cylinder. 
Let A denote the a-algebra generated by the zero time partition {o[e] '■ e S E} 
of E, and define, for each integer to < 1, 

Am • — \J S 

i—m 

which is the smallest cr-algebra containing all cr-algebras Vr=m S~^A, n > m, 
where the latter consists of finite unions of cylinders m[sm, e„]. 

Let (j)Q be a finite non- negative measure on Aq. Let (j)m denote the measure on 
Am given by 

for all TO < 0. 



In [27] the following dynamically defined outer measure on E was introduced. 
It arose very naturally from the need of measuring some subsets of S which 
depend on the whole past under circumstances where they can be covered only 
with infinitely many sets € Am with known values (pm{Am), m < 0. 

Definition 1 For Q c'S, set 



It is quite straightforward to check that $ defines an outer measure on S (e.g. 
see [27]). Moreover, it is not difficult to verify that $ is exactly the outer 
measure used for the Carateodory's construction of a measure if 0m 's satisfy 
Kolmogorov's consistency condition (see Proposition 1). In the following, it will 
be shown, in particular, that our generalization of Carateodory's outer measure 
is a way for obtaining measures on product spaces from measures on subspaces 
which do not satisfy Kolmogorov's consistency condition, but are consecutive 
images of each other under the shift map. 

An other observation which can be made at this point is that the definition is 

possible only by the Axiom of Choice. However, this will not repel a scientifically 
minded reader because it will be shown below (Lemma 5) that a family of 
covering sets {Am)m<o of a Borel set can be chosen in such a way that only 
finitely many of them are non-empty. Therefore, the definition of $ can be 

legitimately called a construction. 

This is important because it will be shown in Section 2 that $ allows to obtain 
certain equilibrium states. The construction of equilibrium states for dynamical 
systems is one of the tasks of mathematical physics. It became a subject of 
a rigorous mathematical analysis under the name of Gibbs measures [16] [21] 
[22] [24] since the seminal works of Bogolubov and Hacet [7], Dobrushin [12], 
Ruelle [20] and Sinai [23], generalizing the Boltzmann distribution, which has 
been used in physics as a distribution which minimizes the free energy of cer- 
tain systems. The main motivation for these efforts was the construction of 
physically meaningful invariant measures for dynamical systems, which these 
systems asymptotically seek to achieve starting from measures about which we 
have some partial information. As far as the author is aware, the existence of 
equilibrium states is known only for upper semicontinuous energy functions [16], 
but there are no universal way for a construction of them so far even for continu- 
ous functions (usually some stronger continuity conditions, such as summability 
of variation, are required). 
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It will be shown in Section 2.1 that the construction of $ allows to obtain 
equilibrium states for some random dynamical systems introduced in [26] as 
contractive Markov systems. They are a unifying generalization of les chatnes 
a liaisons completes [11], g-measures [17] and iterated function systems with 
place dependent probabilities [1] which allows to formulate the results on stabil- 
ity of them in a language which is more systematic and natural for this kind 
of questions. They arc known to posses sometimes several stationary states 
[9], [5]. Taking into the account the wide spectrum of applications of them in 
the modern science (e.g. [3], [2], [10], [14], [25], [4]) leaves no doubts that the ques- 
tions on stability of them are no less important than curious. It was shown in 
[28] that the energy functions associated with such systems are not even upper 
semicontinuous in general (even in the case of the usual regularity conditions on 
the probability functions). Nevertheless, the existence of equilibrium states for 
them has been proved [28]. However, the task of the construction of equilibrium 
states for such energy functions from non-invariant initial measures remained 
open. All author's attempts to use the well know technics of Gibbs measures 
failed. Here we obtain them using the construction of $ even under conditions 
which are much weaker than those assumed in [28]. The definition of $ re- 
sembles some of the constructions of Gibbs measures [23] and connects it with 
the general way in which measures are constructed in the Measure Theory [6]. 
Moreover, it is not difficult to see that the definition of $ can be easily extended 
to more general dynamical systems. 

Every theory is based just on a few examples. In almost every text book, Gibbs 
measures arc illustrated with the help of finite Markov chains, which arc just 
trivial cases of contractive Markov systems. If an example does not fit into the 
theory, the latter needs to be modified. Every working example is guiding in 
this situation and therefore should not be ignored. 

Now, we will refine the definition to make it more easily applicable in some 
situations. Also, this will make the previous claims more obvious. 

For each m < 0, let Am denote the algebra consisting of all finite unions of 
cylinders of the form m[em, e-m+i--, en], ei £ E, m < i < n. Set 



E{Q) := <^ {Cm)m<o ■Cm&^m for all m < and Q C |J C, 

[ m<0 

for all Q e S. 

Since each generates the cr-algebra Am, the following lemma shows that the 
definition of $ is a generalization of the usual definition of an outer measure 
from the standard Measure Theory, which is used for the Carateodory's method 
for obtaining a measure, as mentioned above. 
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Lemma 1 Let Q C S. Then 



$(Q) = inf <^ ^ <l>m{Cm) : {Cm)m<0 ^ ^(Q) 



m<0 



Proof. Clearly, the left hand side of the claimed equation can not exceed it's 
right hand side. 

On the other hand, by the definition of $(Q), there exists a sequence ((^m)m<o)„£N C 
C{B) such that 

^ (f>m{A'^) i ^(Q) as n 00. 

m<0 

By the standard approximation theory, for every n € N and m < there exists 
G Am such that c C;^ and 



ic:,\Ai)<—. 



n 



Therefore, 



<- + 

n 



m<0 



This implies the claim. 



□ 



The class of the covering sets in the construction of $ can be restricted even 
further. Set 



E{Q) := J {Bm)m<o : -Bm G A„, B„ n S„ = Vm 7^ n and Q C \J 



m<0 



for all g C S. 

Lemma 2 Let Q CT,. Then 



$(Q) = inf <^ ^ <Pm{Bm) : {Bm)m<o e ^(Q) 



m<0 



Proof. Let $((5) denote the right hand side of the equation to be proved. Then 
obviously 

HQ) > 

Now, let {Cm)m<o € S(Q). Set 



Bm ■■= Cm \ {Cm+1 U ... U Cq) for all m < 0. 
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Then {Bm)m<o S and Bm C Cm for all m < 0. Hence 

m<0 m<0 

Therefore, 

This concludes the proof. □ 

Now, we give a formal proof that 3> is a natural dynamical extension of the 
Carateodory's outer measure which contains the latter as the case with consis- 
tent measures (jjmS. 

Proposition 1 Suppose that (p-i is consistent with (po, i.e. 4>-i{C) = 4>o{C) 
for all cylinder sets C € Ao- Then $ coincides with Carateodory's outer measure 
which extends the set function (j) defined for every cylinder set C € Am, m <Q, 
by 4>{C) -^miC). 

Proof. Let M denote Carateodory's outer measure extending the set function 
(p. Let Q C S and {Am)m<o G '^{Q)- Since each Am can be written as a finite 
disjoint union of some cylinders Cim, Cn^m from Am, 

J2 'PmiAm) - YY^^^^km) > M{Q). 

m<0 m<Ofc=l 

Hence, 

m) > M{Q). 

Now, let {Cn)neN be a sequence of cylinders such that Q C UneN^"- "^i 
be the largest non-positive integer such that Ci G »4„ij. Set B„ii ■= Ci and 
Bm = for all rui < m < 0. Recursively, assuming that all Bm's are defined 
for all m„ < m < 0, choose m„+i < m„ such that C„+i € Amn+i set 
5m„+i := C'n+i and Bm = % for aU m„+i < m < m„. Then {Bm)m<o & ^(Q). 
Therefore, 

Y,4>{Cn) = Y '^(^™) = E <l>rn{Bm) > 
neN m<0 m<0 

Thus, 

M(Q) > cE.(Q). 

This completes the proof. □ 
The following Lemma is useful for verifying that $(!]) > 0. 

Lemma 3 Suppose (j)'^ is a measure on Aq which is absolutely continuous with 
respect to 0o- Let $' denote the outer measure obtained from (pQ as in Definition 
1. Then for every e > there exists (5 > such that, for every Q C S, ^'{Q) < e 
whenever ^{Q) < 5. 
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Proof. See the proof of Lemma 2 (ii) in [27]. □ 

Next, we are going to investigate what happens to <3> under the action of the 
shift map. The action can be considered into two ways. 

Definition 2 For to < 0, let $(m) denote the outer measure $ where (j)m is 
taken as the initial measure on Aq, instead of 0o- 

Lemma 4 Let Q cTi. Then 

$(Q)<$(5-ig)<$(_i)(Q). 

Proof. Let {Am)m<o e S(Q). Then (..., SA^i, SA), 0) G S(S'Q). Therefore, 

m<0 

bmce (pm—i 

{SA^) = 0„(A„O for all TO < 0, 

m<0 

This implies 

^SQ) < $(Q), 
which is equivalent to the first inequality. 
On the other hand, since {S~^Am)m<o € E{S~^Q), 

* (S-'Q) < ^ 0m (S-^A^) . 

m<0 

This gives 

$(^-'g)<$(-i)(0). 

□ 

Obviously $ is finite since 0o is finite. Therefore, by Lemma 4, we can make 
the following definition. 

Definition 3 For Q cT,, set 

$*(Q):= hm 

Obviously, <E>* is an outer measure. By Lemma 4, <1> < 

Next theorem bears the fruits of the construction. 

Theorem 1 The restrictions of $ and $* on the Borel a-algebra are shift in- 
variant measures. 
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Proof. We start with By Lemma 4, we can define 

$(g) := lim $ 

for all Q C S. It is easy to check that $ is an outer measure on S. Also, it is 
clear that it is shift invariant. First, we show that the restriction of $ on the 
Borel cr-algebra on S is a measure. We will demonstrate it using Carateodory's 
method, i.e by showing that the cr-algebra of all i>-measurable sets contains all 
cylinder sets. That is we need to show that 

$(Q) > $(gnc) + i(Q\c) (i) 

for all cylinder sets C and all Q C S. 

So, let C be a cylinder set and Q a subset of E. Then there exists n > such 
that 5~*C G Ao for alH > n and hence S'~*C € for alH > n and m < 0. 
Let i > n and {Am)m<o G C{S-'Q). Then 

4>m {Am) = ^ .^m [Am H S-'C) + <l>m (^m \ S-'C) . 

m<0 m<0 m<0 

Since {Am^S-iC)m<o&C{S-\Qr^C)) and (A„\5-^C)™<o e C(5-^(g\C)), 
{Am) > * {S-\Q n C)) + $ {S-\Q \ C)) . 

m<0 

Hence 

$ {s-'Q) > $ {s-'{Q n C)) + $ {s-\Q \ C)) . 

Taking the limit gives (1). 

Let i? C S be a Borel set. The first part of the claim will follow, if we show 
that ^{B) = By Lemma 4, 

Let B' C S be a Borel sot. Since $ is a Borel measure and 3" is an outer measure 
with $(E) = ^(S), by Lemma 4, 

l>(E \ B') ^ - ^{B') < - $(B') < \ B'). 

So, for B' := S \ B, we get 

as desired. 

It is possible to deduce the second part of the claim from the first. Here we give 

a proof of it which is independent from the proof of the first. To show that 
is a shift invariant Borel measure, observe that, by Lemma 4, 

^{-i){Q) < ^i-i){S-'Q) < 
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for all i € N. Taking the limit gives 

$*(5-ig) = $*(Q). 

Now, we show in the same way that $* is a Borel measure. Let {Am)m<o 6 C{Q). 
Observer that n C))m<o € C{S-'{Q n C)) and {S-'{Am \"C))m<o G 

C{S-'{Q \ C)) for aU i > n. Therefore, 



?!'m-2i (^m) = ^ '/>m-i (-S M„) 
m<0 

= ^ </.„_i nC)) + J2 ^m-i {S-\Am \ C)) 



m<0 m<0 



> n c)) + \ C)) 

> (Q n C) + (Q \ C) 

for all i > n. Hence, 

'^i-2i) iQ) > <^i-i) {Qnc) + (Q \ c) . 

Taking the limit gives 

$*(Q) >$*(QnC) + $*(Q\C). 
This completes the proof. □ 

In the following, we will use the same notation for measures obtained in Theorem 
1 as for outer measures $ and $* if no confusion is possible. 

At this point, it is easy to see that the family of the covering sets of Borel sets 
in the definition of $ can be restricted further. Set 

C{B) := {{A,n)jn<o e E{B) : at most finitely many 7^ 0} 

for all -B C S. Choosing elements from finitely many cr-algebras does not requite 
The Axiom of Choice. The next lemma brings $ back to the constructive world. 

Lemma 5 Let B c'S be Borel. Than 

= inf V ci)m{A„). 

(Am)m<oeC(S)„<o 

Proof. First let C C S be compact. Obviously, 

$(C)< inf . V</>„(A„). 

On the other hand, by the compactness of C, for every (^m)m<o 

6 S(C) there 

exists {A'^)m<o € C{C) such that 

J2 'Pm{Am) > > , inf . Yl 't>m{A'^)- 

m<0 m<0 (^m)m<oeC(C)„<o 
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Hence 

> inf V </>„(A„). 
(A„.)^<oef(C)^o 

Since the class of compact subsets contains the family of all cylinder sets, the 
claim follows by Theorem 1. □ 

It has been shown in Theorem 1 that the definition of <i> let's to obtain a nice 
shift invariant measure on E. The next example demonstrates that it works not 
always. 

Example 1 Let E := {0, 1}^ and cr' e S given by 



cr,- = 



if i is even 

1 otherwise 



for all i € Z. Let 0o be the probability measure on Ao given by 

... J 1 if cr' G A 
m^) - I otherwise 

for all A e Ao. Then for {Am)m<o £ S(E) given by Aq o[l], ^-i := o[0] 
and A„i := for all m < -2, J2m<o 'l^miAm) = 0. Hence $(E) = 0. Similarly, 
by swapping o[0] and o[l] if necessary, one sees that each = 0. Thus 

$*(E) = also. 

However, from [27] we know examples where $ gives useful non-zero measures. 

It is natural to hope that, in case ^(E) > 0, it is a probability measure if (fiQ is 
one. The following proposition shows in particular that it is not true in general 

Proposition 2 Suppose (po is a probability measure. Then 

(i) $(E) < I, 

(a) \(t>ni{A) - (t>o{A)\ < 1 - $(E) for allAeAa and m < 0. 
(Hi) The following are equivalent: 

a) $(E) = 1, 

b) MS~'^A) = 0o(^) for all A G Aq, 

c) ^ uniquely extends {(t>m)m<o on the Borel a -algebra. 

Proof, (i) It is clear that $(E) < 1, since (...0,0, E) e C(E) and (t)o is a proba- 
bility measure. 

(ii) By the definition of $ and Theorem 1, for every A& Ao and m < 0, 

1 - cl>m{A) = cPmi^ \ A) > $(E \ A) = $(E) - > $(E) - M^)- 
Hence 

cj>m{A) - MA) < 1 - 
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Applying this inequality to S \ A gives (ii). 

(iii) The implication form a) to b) follows immediately from (ii). The impli- 
cation from b) to c) follows from Proposition 1 and Kolmogorov's Consistency 
Theorem. The implication from c) to a) is obvious. □ 

By Proposition 2, a normalization of $ is in general necessary if > 0, which 

is a typical situation in statistical mechanics. Non-typical in this approach is 
that we don't need to require some convergence in so-called 'thermodynamic 
limit' to obtain a measure on the Borel a-algebra. 

We conclude this section by giving some sufficient conditions on (po for the 
positivity of 

Proposition 3 (i) Let u be a positive Borel measure on S. Let (f)',^ denote the 
absolutely continuous part of the Lebesgue decomposition of (pm with respect to 
u. Suppose there exists a Borel-measurable function f such that d4>'^/dv > f 
for allm<0 and J f di^ > 0. Then ^(S) > 0. 

(ii) Suppose there exists a positive shift invariant measure on Ao which is abso- 
lutely continuous with respect to 00 ■ Then > 0. 

Proof, (i) Observe that 

for all {Am)m<o S C(S). Therefore, the claim follows, 
(ii) The claim follows by Lemma 3 and Proposition 2 (iii). 

□ 

Next section provides in particular some physically meaningful examples where 
$(!]) > 0. 



2 Equilibrium states 

In this section, we intend to show that construction of $ allows to obtain equi- 
librium states for some energy function u : S — > [—oo, 0]. 

Definition 4 Let PsC^) denote the space of all shift invariant Borel probability 
measures on S and h^iS) be the Shannon-Kolmogorov-Sinai entropy of S with 
respect to A e -Ps'(S). Ao £ Ps{^) is said to be an equilibrium state for u iff 

hAo{S)+ / udAo= sup \hA{S)+ / udA\ . 
J AePs(s) I J ) 

The physical interpretation of it is that the equilibrium state is a state which 
minimizes the free energy of the system. 
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To proceed towards our goal, wc need to split each cr-algebra Am, m < 0, into 
two pieces, the one which depends on the past and the other which depends on 
the future. 

Definition 5 Let G denote the a-algebra on E which is generated by cylinders 
of the form i [ei, Ci G E, 1 < i < n, n G N. For rn < 0, let Tm denote the 
finite cr-algcbra on S generated by cylinders of the form m[&m, •••,eo], Cj € E, 
m <i <0. Finally, let denote the a-algebra generated by Uto<o -^m- 

Recall that by Kolmogorov-Sinai Theorem, 

flAiS) = - E /^A (l,[e]|^) logi^A (l,[e]|^) ^A, (2) 

where Ea (li[e] 1-^) denotes the conditional expectation of the indicator function 
conditioned on with respect to A. /ia(S') is interpreted as a measure of 
uncertainty of observing the next symbol of process A given its past. This is 
the reason for the split on the past and the future. 

From (2) follows the desire to be able to compute the conditional expectations 
with respect to $, which might help to verify the equilibrium state property. 
This seems to require an extension of the standard theory of Martingales to 
adapted random variables with different underlying probability measures. Such 
an extension is done in the next theorem, which is a simple consequence of the 
construction of $. This can be compared to the result in [18], where (j)m^s are 
assumed to be defined on the limiting cr-algebra and converge in some sense. 

Theorem 2 Let f : E — > M be G-measurable and bounded. Suppose $(E) > 0. 
Then 

Proof. Though the theorem appears to be a generalization of Doob's Martingale 
Theorem, the proof of it reduces to the truth of latter (just as the result in [18] 

does). 

Let m < 0. Since ^'j^^ < 4'm\j^m.': by Radon-Nikodym Theorem, there exists 
'■ S — ^ ^ J'TO-measurable such that — J^^md(pm for all A G Tm- 

Therefore, by the pool-out-property of the conditional expectation, 

j E^^ iflJ^rn) = / ^mfdcl^m = j fd^ 

A A A 

for all AeJ^m- Thus 

E4>m (/l-^m) = E^ {f\Tm) $-a.e. (3) 
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for all m < 0. Since the normalization of $ dose not alter (/|^m)) by Doob's 
Martingale Theorem we conclude that 

□ 



2.1 Equilibrium states for random dynamical systems 

Now, we are going to apply the theory developed in this paper to some random 
dynamical systems introduced in [26] as Markov systems. It is known that 
the asymptotic behavior of contractive Markov systems is similar [26], to some 
extent, to the trivial case of finite Markov chains. However, the question on 
the necessary and sufficient condition for the uniqueness of the stationary state 
for such systems remains open already for more than seventy years. A reason 
for that might be the lack of suitable mathematical tools. This paper provides 
some new tools. They allow us to obtain new useful results about Markov 
system. On the other hand, this gives an example of non-zero measures $ 
obtained from measures on sub-a-algebras which do not satisfy Kolmogorov's 
consistency condition. 

It was pointed out by an anonymous referee that it might be appropriate to cite 
in this paper the work by A. Lasota and J. Yorke [19] where a general method, 
called the lower bound technique, useful in providing criteria for a stability of 
such systems is presented. 

Let (ii'j(e), We,Pe)gg^ be a Markov system [26], i.e. Ki, Kn is a partition of a 

complete metric space (K, d) into non-empty Borel subsets, i : E — > {1, 
surjective and t : E — > {1,...,A'^} such that, for every e € E, Wg : Ki(e) — ^ 
Kt(e) and Pe : -ft'i(e) — > (0,1] such that EeeE,i(e)=iPe(a;) = 1 for all x G Ki, 
i S {1,...,7V}. We can consider each pe to be extended on K by zero and each 
We to be extended on K arbitrarily. We assume that each Pe\Ki(e) and We\Ki(e) 
is uniformly continuous, where notation \a means the restriction on a set A. 

A Markov system is called contractive iff there exists < o < 1 such that 

^ Pe{x)d{weX, WeU) < ad{x, y) for all X, y G ifj, i = 1, N. (4) 

Let B{K) denote the Borel cr-algebra and P{K) the set of all Borel probability 
measures on K. Let U be the Markov operator acting on real- valued functions 
/ on if by 

and U* be its adjoint operator acting on Borel probability measures u on K hy 
U*v{B) = J U{lB)dv for all B G B{K). 
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Let X £ K. For each integer m < 1, let be the probability measure on the 

(7- algebra Am given by 

m[em,---,e„]) = Pe™(a;)Pe^+i(We„(a;))---Pe„(u'e„_i O ■•• O We^{x)) 

for all cylinder sets „i[e„,,, .... e„], n > m. It has been shown in [27] Lemma 1 
that the function x i — )■ P™(y4) is Borel measurable for all A e Am (for that 
only the Borel measurability of p^s and WeS is needed). 

Definition 6 For v e P{K), let 4)m{v) be the probability measure on ^„ given 

by 

<^„(i/)(^) := j P^{A)du{x) for all A e 

Observer that, for each « > 0, (j)miU*^u) and (j>miy) ° also define measures 
on for all m < 0. The following lemma states their relations to 4>m{i^)- 

Lemma 6 Let m < and v e P{K). Then 

ft) (bm-l{iy){Q) = 4>rn{U*v){Q) = 0„,(l.) (S-'Q) for dl Q & Am, 

(ii) (i}m-i{i^){Q) = (t>m,{v) (S-^Q) for all Q G Am-i- 

Proof, (i) We show only the second equation, the proof of the first is the same. 
It is sufficient to check that the measures agree on all cylinders generating Am- 

(i.) {s- 777, [ei, ...677, 

= / $^Pe(a;)Pre(x)U[ei,...e„])rf!/(a;) 
P;rim[ei,...en])dU*iy{x) 

For (ii), observe that 

(pm{i^) {S~^m-i[ei,—en\) = 4>m{i') (m[ei, ...e„]) = (pm-iM (m-i[ei, ...e„]) . 

□ 



/ 



Definition 7 For 1/ G P{K), let ^{v) and ^*{v) be the outer measures and 
measures as defined in (1) and (3) with ^to(i/)'s standing for (jf>m's. 

Remark 1 Observe that, by Lemma 6 (i) , measures (j)m {1^) satisfy Kolmogorov's 
consistency condition if v is an invariant initial distribution of the Markov sys- 
tem. In this case, outer measure ^{y) is the usual outer measure used for 
Carateodory's construction of a measure. In general, 4>m{vys have exactly the 
properties of (/)m's from Section 1. In particular, outer measure $(_j)(z^) is 
nothing else but $(17**!^) for all i > 0. 
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The following simple lemma states some properties of the map v 



Lemma 7 Let v\,i'2 G P{K) . Then 

(i) <C $(^2) ifi^i *C f2, where <C denotes the absolute continuity relation. 

(ii) For < a < 1, 

^{avi + (1 - 01)1^2) > + (1 - a)^{u2)- 

Proof, (i) Observe that 00(1^1) ^ </'o(t'2)- Therefore, the claim follows by Lemma 
3. (ii) is a direct consequence of the supperadditivity of the infimum. □ 

We will use the following initial distributions for the Markov system. 
Definition 8 Fix Xi € Ki for alH = 1, AT and set 



where denotes the Dirac probability measure concentrated at Xi. Let ^ 
S C {1, AT} and set 



where \S\ denotes the size of 5. 

Proposition 4 (i) For v e P{K), the following are equivalent: 

a) $(z/)(S) = 1, 

b) U*v ^ V, 

c) uniquely extends (pm{i^) 's on the Borel a-algebra. 

(ii) Suppose there exists n € P{K) such that U*n = 11 and P° << Py for all 
x,yeKi andieS := {j : n{Kj) > 0}. Then $(t'o)(S) > 0. 

Proof, (i) The claim follows from Lemma 6 and Proposition 2. 

(ii) Clearly, it follows from the hypothesis that P° << (j}o{i'Q) for all x G Ki and 

i € S. Therefore, c!)o(/i) << 0o(j^o)- Hence, by Lemma 7(i), $(/(i) << ^{i^o). 
Since, by (i), <l?(/i)(S) > 0, the claim follows. □ 

Example 2 It has been shown in [15] that there exists an invariant initial Borel 
probability distribution /x for a contractive Markov system on a Polish space if 
{Ki)fLi form an open partition of K. The condition of equivalence of measures 
P° and Py for all x, y S Ki, i = 1, ...,N, is satisfied e.g. if probability functions 
Pe|/fi(e)) e € of a contractive Markov system have a square summable varia- 
tion and are bounded away from zero [29]. By Proposition 4 (ii), $(i/o)(S) > 
for such systems. As far as the author is aware, the first result on the equiva- 
lence of measures P^ and Py was obtained by J. H. Elton in [13], in the case 
when the partition has the single atom and the probability functions have a 
summable variation (Dini continuous) and are bounded away from zero. 
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Definition 9 Set 

Eg := {(T e S : i((T„+i) = i(cr„) for all n G Z} 
{subshift of finite type associated with the Markov system) and 

D := \ a gEg ■■ lim w^^ o ... o (a^ifa^)) exists \ . 

-D is a J-'-measurable, e.g. one can see it quickly as follows. Let's abbreviate 
^mi'^) •= ^CTo ° ■■■ ° ^T„(a;i(cr„)) for all a € T,. Clearly, D = {a € Eg : 
(w^(a-))m<o is Cauchy }, by completeness of K. For each m < and n > set 
Qmn ■■= OkKoW e Eg : w^+fc(tT)) < 1/n}, which are obviously J^- 

measurable sets. Then D — HneN Uni<o Qmn and therefore it is J^-measurable. 

Proposition 5 Suppose the Markov system is contractive. Then 

(i) $K)(E\£>) =0 and 

(ii) D c S-'^D. 



Proof, (i) It was demonstrated in [27] that 

$(i/o) {^\D)= 0, 

which is a direct consequence of the contractivcncss condition (4) (no continuity 
of Pe|/fi(5)'s or We|i4'i(e)'s is required for that). Since v'q <C fo, the claim follows 
by Lemma 7 (i). 

(ii) Let -^i(e) denote the closure of -ft'i(e), e G E. Since each WbIkh^^ is uni- 
formly continuous, there exists a unique continuous extension of We on -ftTj^g) 
(e.g. Theorem 2, p. 190 in [8]), which we will denote with We- Let a £ D, then 
there exists y G Kif^^^^ such that y = lim„_>._oo o ... o w<t„ (a^iCo-^)) • Hence, 
Wo-i (y) = limTO^._oo f^ai o Wo-o o ... o Wcr^ (a;j(<^^)). Therefore S{a) e D. That is 
a e 5-11). □ 



Definition 10 Set 

F:Y^ — >K 

by 

[ lim w,,^, o w^_^ o ... o w„^{xi(^„^^) iia € D 
F{a) := < "»->~oo 

I a;t(o-o) otherwise, 

We call F the coding map of the Markov system. It is obviously J^-Borel- 
measurable, as it is the pointwise limit of ^-Borel-measurable functions Fm 
given by Fm{a') := w^{a) if a G D and Fm{cr) = Xt{cro) otherwise for all m < 0. 



Note that F might be meaningful not only for contractive Markov systems. For 
example, if normalized $(t'o) is ergodic, then ^{i'q){D) = 1 or ^{u'q){D) = by 
the shift invariance of D (Proposition 5 (ii)). 
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Lemma 8 Suppose the Markov system is contractive. Then F ($(z/o)) is a 
Radon measure. 



Proof. Obviously, F ($(^3)) is a Borel measure, since F is in particular Borel- 
Borel- measurable. Furthermore, F ($(i^q)) is regular, since is a metric space 
(e.g. Theorem 7.1.7, p. 70, Vol. II in [6]). So, the claim will follow if we show 
that F ($(i'o)) is tight, since an intersection of a compact and a closed set in K 
is compact. 

Let e > 0. By Lemma 3 (iii) in [27], there exist a compact set Q C T, with 
^{vo){T, \ Q) < € such that F\q is continuous. Set C := F\q{Q). Then C is 
compact and 

Fm,yo)){K\C) = <i>M{^\F-HC)) 

< $m(s\(^^1q)-^(c)) 

< e. 

Hence F($(i'o)) is tight. By Lemma 7 (i), F($(j^q)) is absolutely continuous 
with respect to F ($(z/o)), therefore F ($(i/q)) is also tight. □ 



Definition 11 Set 

/ ^°SP<^i ° if G 

^ ' ' \ —00 otherwise, 

with the definition log(O) = —00. We call u the energy function for the Markov 
system. Recall that u is not upper-semicontinuous in general [28] (even for con- 
tractive Markov systems with an open partition), therefore the existing theory 
of thermodynamic formalism is useless in our situation. 



Observe, that with the above notation each measure (^m(i^(A)) has the following 
form 



n-l 

0„(i^(A))(„[ei,...,e„]) = / exp^wo5'MA, 

, i=0 



if A(£)) = 1 and each is open in K, which is similar to the Sinai's starting 
point for a construction of a Gibbs measure [23]. 



Definition 12 Let u G P{K) and m < 0. Set 

~^m{v){A xQ):=j P;^{Q)du{x) 
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for all A G I3{K) and Q G Am- It is not difficult to sec that (t>m{v) extends 
uniquely to a probability measure on the product a-algebra B{K) ® Am with 

^m{vW) = J fT iWe^: {x, a) e ft}) dv{x) 
for all 9. G B{K) ® Am and 

for all B{K) (g) ^m-measurable and ^m(i/)-integrable functions ^ on x S (see 
[28]). 

Analogously to Lemma 6 one readily checks that 

^m-i{'^){KxQ) = ^m{U*i^){KxQ) (5) 
for all Q G Am, m < 0. 

Proposition 6 Let e € E and m < 0. Then the following is true. 
(^) 

^<t'ra{i''o) (li[e]l-^m) W =PeO W^o ° - ° Wa^iXif^^m)) (6) 

for (l)m{i^o)-a.e a G S. 

(ii) Setpem{x, c) := Peow^g o ...owa^{x) for X G K and cr G S. Let v G P{K). 
Then 

{Pe{m-1)\K (E) Tm) = Pem (7) 

(j)m-iii^)-o-e., where K ® Tm denotes the product a-algebra of the trivial a- 
algebra on K and Tm ■ 

Proof. Let m[sm, •••560] be a cylinder from Tm- Then 

j l,[e]#mK) = j P^^ {m[em,---,eo,e])diy'o{x) 



eo])Pe O O ... O We^ix)diy'Q{x) 

j j PeOWaoO ... o Wa^{xi(^^^))dP^{a)dt/'o{x) 

m[em,.--,eo] 

J PeO W<7o ° - ° WaAXi{a^))d(l>m{l^o){(^)- 



m[em,.--)eoJ 



Therefore (i) is true. 
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For (ii), observe that, by (5), 

PeOWcro o ... o Wcr^_Ax)d(f>m-i{i'){x,a) 



I 



-Jf Xm[e„,...,eo] 

= / P^~^ {m-l[em-l, ■■■,eo]) Pe O Weo O ... O We^_i(x)dv(x) 

^ em-l 

= J U{P"'{m[em,-,eo\)Pe°WeoO...OWe^){x)du{x) 

= j j PeOW„^o ...owa^{x)P^{a)dU*v{x) 

m[em,...,eo] 

= j Pe O Wag ° ■■■<=> W„^{x)d(f)m-l{l^){x, a), 

as it is claimed. □ 

Remark 2 Observe that equation (7) indicates some Martingale like behavior 

of functions (pem)?n<o- In fact, by Kolmogorov's Consistency Theorem, it is a 
martingale equation if v is an invariant initial distribution for the Markov sys- 
tem (see Proposition 4 (i)). This seems to indicate the truth of a more general 
Martingale Theorem where an adapted sequence of functions satisfies the recur- 
sive averaging of a martingale with respect to some measures on non-decreasing 
cr-algebras which do not satisfy the Kolmogorov's consistency condition. Such 
a result has been proved in Theorem 2. According to it, the left hand side of 
(6) converge to the conditional expectation on the limiting a-algebra almost 
everywhere with respect to measure $ (vq). 

Lemma 9 Let e G E. Suppose 3'(i/o)(S) > and «'(fo)(S \D)=Q. Then 

^*K)(li[e]l-^)=PeoF $K)-a.e., (8) 

where pe denotes the continuous extension of pe\Kn^) on the closure of Ki(^e) 
(e.g. Theorem 2, p. 190 in [8]). 

Proof. By Proposition 6 (i) and Theorem 2, 

(li[e]l-^) = J^^P<^ ° ^-^0 ° - ° Wa^{Xi(^^)) 

= Pe ( lim O ... O ) 

= PeO F{(j) 

for <b{vQ)-&.e. a & D. The claim follows. □ 
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Theorem 3 Let e e E. Suppose $(i/o)(S) > and at least one of the following 

conditions holds true: 

(i) the Markov system is contractive, 
(a) K is separable and $(i'g)(E \ D) = Q. 

Then 

=feoi^ $K)-a.e.. (9) 

Proof. By Proposition 5(i) and Lemma 9, 

^$(.^) (li[e]l-^) =PeoF $(z/^)-a.e. 

in both cases. Suppose there exists eo <E E such that F{^{i'^)){{peg > Peo}) > 0. 
Observe that, by the hypothesis, F{^{i'q)) is a Radon measure, in case of (i) 
it holds true by Lemma 8, in case of (ii) it is a well known fact (e.g. Theorem 
7.1.7, p. 70, Vol. II in [6]). Furthermore, the restriction of a Radon measure 
on a Borel set in a metric space is a Radon measure also. Therefore, by Lusin's 
Theorem (e.g. Theorem 7.1.13, p. 72, Vol. II in [6]), there exists a compact set 
C C {peg > Peo) such that F{^{uq)){C) > and the function J2eeEPe\c is 
continuous. Then 

eeE eeE 

for all X € C. However, by the above. 
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F-i(C) 



= 1, 

which is a contradiction. Therefore, the claim is true. □ 

Corollary 1 Suppose $(i/q)(S) > and it is normalized and at least one of the 
following conditions holds true: 

(i) the Markov system is contractive, 

(ii) K is separable and $(i'q)(E \ D) = 0. 

Then '^{v'q) is an equilibrium states for u and 
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Proof. The claim follows from Lemma 5 in [28]. For completeness, we prove it 
here in our case. By Theorem 3, 

ee-E /, 

= - Jlogp,,oF{a) d^iy'o){a). 

That is 

h^^^,)iS)+ JudHui) = 0. (10) 
To complete the proof it remains to show that 

hA{S) + J udA<0 (11) 

for all S-invariant Borel probability measures A. For set 

Qe ■■= Ea (li[e]|-^) 

for each e & E. Then as above 

hA{S) = -Y, flogged A. 

e€E /, 

If A({u = — oo}) > 0, then hA{S) + J u dA — — oo < 0. Otherwise, observer 
that 

hA{S)+ judA = Y. I log^rfA<^ / f^-l) dA. 



It is not difficult to check that li[e](Pe ° F / g^. — 1) G >C^(A) for all e G 
(e.g. Lemma 2 in [28]). Therefore, by the pull-out property of the conditional 

expectation. 



= 'Y (PeoF-ge) dA 



= 1-1 



= 0. 

This implies (11), as desired. □ 
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Corollary 2 Suppose $(i'o)(S) > and at least one of the following conditions 
holds true: 

(i) the Markov system is contractive, 
(a) K is separable and $(i'q)(S \ D) = Q. 

Then 

^K)Uo ='^o(i^(<!>K))). (12) 

Proof. The claim is a straightforward consequence of Theorem 3. Observe 
that E^^^,-^ (lj[e]|~^) o S*^" is J^-measurable, for all n G N, since S{F) C T. 

Therefore, by the shift invariance of $(1^0) and the pull-out property of the 
conditional expectation, 

00 (F($(,.^)))(o[ei,...,e„]) 
= yP^(<.)(i[ei,...,e„]) 

= y ^*(.,) (l,[e,]|7-) oS-"+l£;*(.„) (l,[e,]|7-) o5-"+^..l,[e„] 

= *K)(i[ei,-,e„]) 
= ^K)(o[ei,-,e„]) 

for all cylinders o[ei, e„] € The claim follows. □ 



Proposition 7 Suppose $(t'o)(S) > and $(t'o)(S \D) = Q. Then 

C7*i^($K))=F($K)). 



Proof. Let / be a real-valued, Borel-measnrablc and bounded function on K. 
Let We denote the continuous extention of We\Kn^) on the closure of -K'i(e) for 
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all e G E. Then, by Theorem 3 and the shift invariance of ^{vq), 

U*F {<i>{,y'o)) if) = Pef ° dF 

TP 



*^ ^r- IP 



< 



/ ^PeO Ff OWeO F d3>(i/o) 
eeE 

= E / ^^le]fo^SeOFd^u'o) 
eeE'' 



eeE ', , 
i[e] 



= y/dF($K)). 

Hgd-CG 

[/*i^($K))(/)<F($K))(/). 

Since / was arbitrary and both measures have the same norm, they must be 
equal. □ 

We conclude the paper with a list of questions which it opens. 

1) Arc Borel measures $ and $* equal? 

2) Is <i?(i/Q)(S) > for some Vq for every contractive Markov system with the 
Feller property? 

3) Can every equilibrium state for u be obtained as a normalized ^{i'q) (observe 
that A{D) = 1 if A is an equilibrium state for u)? 
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Erratum: Dynamically defined measures and equilibrium states 

Ivan Werner''' 
(Dated: 20 June 2012) 



The purpose of this note is to correct some errors which 
the author found in the proofs of Theorem 2 and Lemma 
9 in^. The error in the proof of Theorem 2 seems to be 
fatal. In any case, the theorem is not that simple conse- 
quence of the construction of $. However, Lemma 9 and 
all the results which follow from it still can be proved 
under apparently stronger assumptions. These assump- 
tions are still strictly weaker than the usual assumptions 
for constructions of Gibbs measures, such as summability 
of variation of the energy function (see Example 2 in^ and 
Example 3 in^). In particular, the assertion of the paper 
that the proposed measure-theoretic technique allows to 
construct equilibrium states in the thermodynamic sense, 
which minimise the free energy of the dynamical system, 
for some energy functions which are not upper semicon- 
tinuous is still correct. 

Lemma 9 and Theorem 3 in^ can be replaced with the 
following lemma. 

Lemma 1 Let e £ E. Suppose M. is contractive with 
P° < Py for all x,y e Ki and 1 < i < N , and there 
exists /i G P{K) such that U*ii = Suppose each Ki is 
open. Let S := {i\ ^,{Ki) > 0} and := i/\SU2ies ^^i- 
Then 

^*(.^) (liWl-^) =PeoF $(^^)-a.e.. (1) 

Proof. By the hypothesis and Proposition 4 (ii) in'^, 
<^{iy'f^){T,) > 0. Let A £ Aohe such that (j)o{^J.){A) = 0. 
Then P°{A) = for ^-a.e. x € K, with i e S. 
Hence, by the hypothesis, P°. (A) — for all i E S. 
Therefore, 0o(i'o)U) = 0- 'Thus 0o(i^o) < MfJ-)- 
Hence, by Lemma 2 (ii) in^, $(t'o) ^ ^il^)- It is 
a well know fact that for any positive shift-invariant 
Borel measures A and M, absolute continuity relation 
A < M implies that E'a/ (li[e] |J^) = £'A(li[e] |J^) A- 
a.e. (as the shift-invariance of the measures implies that 
dA/dM o S ^ dk/dM M-a.e., where dk/dM is the 
Radon-Nikodym derivative, which in turn implies that 
EM{dk/dM\F) o S = EM{dk/dM\T) M-a.e., and this 
implies the fact). Therefore, 

^t-i^l,) (liWl-^) = E'S'M (liWl-^) $(i^o)-a.e.. 



Furthermore, by Lemma 6 in^ or Theorem 1 (iii) in'^, 
^^(m) (liW 1-^) =Pe°F $(/x)-a.e. 

(the requirement of Lemma 6 in^ that 

^f^i Jj^. d{x, Xi)dii{x) < oo was not necessary, as 
it is true for every invariant measure fi, see Theorem 1 
(ii) in^). This implies the assertion. □ 

Finally, Corollary 1 in^ can be replaced with the next 
theorem. 



Theorem 1 Let e Cz E. Suppose A4 is contractive with 
P" < Py for all x,y e Ki and 1 < i < N, and there 
exists fj, G P{K) such that U* ijl = fi. Suppose each Ki is 
open. Let S :— {i\ n{Ki) > 0} and v'q := 1/\S\ J^ies^^i- 
Then the normalized ^{vq) is an equilibrium states for u 
given by 

u{a) •= I '^°^P<^^ ° ^('^) if(^^D 
^ ' ' 1 —oo otherwise, 

with the definition log(O) := — oo, and 

h^^^,^{S)^~ j ud^{v',). 



Proof. The proof is the same as that of Corollary 1 in^ 
with the only difference that instead of referring to The- 
orem 3 in'^ we refer to Lemma 1 above. □ 
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